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ABSTRACT 


Th« robustness properties of discrete time linear quadratic 
regulator are studied. The return difference equality for a 
discrete time linear quadratic regulator with a prescribed degree 
of stability is achieved. It is found that the guaranteed 
stability margins achieved reduce as the degree of stability is 
increased. It is shown that the stability margins achieved are 
a measure of nearness of the closed loop poles to a circle which is 
interior to the unit circle on the z-plane. Systems with lesser 
degrees of stability, are shown to possess these guaranteed 
stability margins. 
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CHAPTER « 1 

INTRODUCTION 

The thesis attempts robust controller design for a 
Linear time invariant (LTI) discrete time system, 

using the design model, 

X, ® A X, + B u, 

k-f*! Ok K 

subject to minimisation of the quadratic cost function 
iTith prescribed degree of stability . & > 1 ,viz., 

j = E «***[ X* 0 X. + < «k 3 ; 

kaO 

vhere Q is a positive semi definite (p.s.d.) matrix 
[Q & 0) and R is a positive definite (p.d.) matrix (R > 0). 

The robustness properties of the continuous time linear 
luadratic regulator (CLQR) are well-known [1-4]. It is shown that 
for the continuous time LTI system 

X = F X + G u 
the controller , 

u = - L X 

which minimizes the quadratic coat, 

J = / “[ x'*‘q X + u'^R u ] dt; 0 S:0 , R >0 

c o c c c ^ c 

gives rise to the closed loop (CL) system 
X - ( F - G L ) X . 

This CL system has excellent robustness properties. 



2 


The advantages of CLQR with prescribed degree of 
stability e > 0), are brought out by B . D . 0 .Anderson and 

I.B.Hoore [5]. Thus, instead of using the cost function J , above, 

C 

Lf one uses the cost function, 

J = [ x^Q x+u^Ru]dt 

^ o c c 

Q^> 0 ; R > 0 
c c 

the optimal CL system has the following advantages: 

i) The reduction of trajectory sensitivity to plant 
parameter variations as a result of any CL control is greater for a 
regulator with jc > 0 than for * = 0 (Note that with * = 0, 
becomes J). 

ii) There is inherently a greater margin for tolerance 
3f time delay in closed loop when £ > 0. 

iii) There is greater tolerance to non-linearity when 

F > 0 . 


iv) Asymptotically stable bang-bang control may be 
sichieved simply by inserting a relay in the closed loop when ^ > 0. 

Thus, in general, the CLQR with ^ > 0, possesses better 
robustness properties. The manifestation of these robustness 
properties of CLQR with £ > 0 is given in [6]. In that paper, a 
sufficient condition is derived (on the plant perturbation matrix 
and £ , the degree of stability), which when satisfied guarantees 
pptimality (and hence the robustness properties) of the nominally 
pptimal control law for perturbed systems, when fixed perturbations 
pccur in plant state matrix. Thus, £ is used as a design parameter 
to achieve robustness for the perturbed (actual) system. This 
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It is shown in [7] that the stability margins of the 
CLQR do not necessarily guarantee the robustness of "cheap” CLQRs 
which allow large control signals at the input. In [8], it is 
pointed out that there are essential differences between the CLQR 
and the discrete time LQR (DLQR). The effect of these differences 
on the stability margins and the sensitivity properties of DLQR is 
analyzed. These gain and phase margins for a single input-single 
output (SISO) DLQR are derived there. It is found that these 
margins are less than those obtained for CLQR. Moreover, the 
margins are shown to be dependent upon the performance criterion 
used. It is also shown that for some frequencies, the closed loop 
system is more sensitive than the equivalent open-loop system. The 
reason for this phenomenon is stated to be the inherent delay in 
the discrete-time systems which has a destabilizing effect. 

In [9], these margins for multivariable systems are 
found out. It is shown there that the stability margins derived for 
DLQR provide a reliable indication of the robustness of the 
corresponding DLQR CL system (unlike the case of CLQR, as stated 
earlier). Thus, although the guaranteed stability margins for the 
DLQR are small, they are a reliable indication of the robustness of 
the system. 

Uith this background, a development similar to [5,6] 
would be useful and this has been the motivation of this work. 

Much research is being done in using prescribed degree 
of stability for robustness improvement in discrete-time systems. 
In [10], a method is proposed for sensitivity reduced design of 
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ensures the prescribed degree of stability. In [11], tieie domain 
conditions are presented on the appropriate deterministic or random 
characteristics of perturbations to maintain the proper stability 
behavior of the overall system. The system is assumed to be 
nominally stable having certain degree of stability. In [12], the 
stabilization of systems via LQR is considered giving bounds on the 
interval system matrices. 

This thesis attempts to establish the robustness 
properties of DLQR with prescribed degree of stability and manifest 
these in terms of the perturbation in plant state matrix. 

Organization Of The Thesis : 

Chapter 2 consists of the background material required. 
The spectral factorisation of CLQR and its robustness properties 
are briefly reviewed. The detailed development of the spectral 
factorisation of DLQR and the associated gain and phase margins is 
given thereafter. The control laws for CLQR and DLQR with 
prescribed degree of stability are given afterwards. 

In Chapter 3 , the design procedure and the condition 
on the perturbation matrix , as developed in [4] are discussed. 
Then a similar approach is tried out for DLQR. The return 
difference equality for DLQR with prescribed degree of stability is 
derived. Then its associated robustness is discussed. The 
implications are then confirmed by presenting numerical examples. 

In the last chapter , some observations are made and 


conclusions stated. 
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CHAPTER # 2 


THE LQR AND ITS ROBUSTNESS 


1.1 Introduction 

It is well-known that the return difference matrix 
dlays an important role in deciding the robustness properties of 
the system. The minimum, over the entire frequency band, of the 
smallest singular value of the return difference matrix, provides a 
neasure of the stability margins for the system. The spectral 
factorisation of the return difference matrix, then, becomes useful 
in deciding the size of the return difference matrix. In this 
Chapter, the development of the return difference equality for 
both, CLQR as well as DLQR, and the corresponding stability margins 
are reviewed. A brief introduction to the CLQR and DLQR with 
e>rescribed degree of stability follows thereafter. 

2.2 The Continuous Time LQR 

Consider an LTI continuous- time system 

it = F X + G u (2.1) 

where x is the n-dimensional state vector ,i.e.x € IR''. 
u is the a-dimensional input vector ,i.e.u « R”*. 

F « IR and G « r*'**’" are constant state and constant 
input matrices respectively. 

It is required to minimize the cost function 
j = i' “r k'^0 X + u’r u 1 dt (2.2) 
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Both Q and R are assuned to be syntiaetric and real. 

w CT 

It is aesuned that CF,G) is controllable and (F,D^) is 

observable; where D s q . 

c c ’‘c 

The control law which minimises J in (2.2) is given 

CJ 


t>y. 


u = - L X (2.3) 

where 

L = RI‘g'^11 (2.4) 

c 

If € is a p.d., synnetric, unique, real solution 

to the continuous-tine algebraic riccati equation (CARE) , 

f’m + ll'*‘^F -MG R"*g''m + Q a 0 (2.5). 

c c 

From the CARE, the spectral factorisation of the return 
difference matrix (RDM) of the CL System, 


X - (F - G L) X 


( 2 . 6 ) 


is achieved as follows: 

Add and subtract sH from CARE (2.5) to obtain, 

(-si - f’) M + M (si - F) + l'^R^L a 
Here and hence forth, I indicates an identity matrix of 

— T 

appropriate dimensions. Multiply on the left by R^ G (-si - 

F^)~^ and on the right by (si - F)“* G to get 

c 

g’’(-sI - f"^)'^ M G M (si - F)“‘ G 

+R’‘'"“ g’‘(-sI - f')"‘l’‘r L(sI - F)'* G R’‘^* 

c c c 

aR"^*''* G^(-sI - f'*‘)"*Q^(sI - F)"‘ G — (2.7). 

Now, since 

L a R"*’g'^M 

c 


we have 



M G C2.9). 

Add I to both aides o£ (2.7) and use identity (2.9), 
and replace s by j6> , to get 

[I+R‘'^®L(-j6>I-F)’‘G [I+R*'^*L( joiI-F)“*G R"*^®] 

c o o o 

= I + R"^‘^® G’‘(-j<^I - f’')“*Q^( j6il - F)*‘ G 

♦ [i+r‘"'®l *^g r;*""®]* [I+r‘''®L«^G R‘^‘^*] 

= I + R"*^®g’‘®* Q S G R"^^® (2.10) 

c c c c c 

.♦ [ I + L *^G ]* R^ [ I + L S^G ] 

= R^ + g’'** Qc*c^ (2.10-a) 


where = (j<<>I - F)~* and ' * ’ denotes conjugate 

transpose. 

Equation (2.10) is the spectral factorisation of the 

RDH or the so-called return difference equality of the CL system 

(2.6). Note that (2.10) is valid for all -a « [o,as]. 

Now since is p.s.d., R’*''®g’** Q * G R”*^® is also 
c c c c c c 

p.s.d. for all o) e [o,<c]. Hence the following inequality holds. 

[I+R*^®L *^G R"^*'"*]* [I+R*^®L S^G R*^*^®] > I (2.11). 

It is shown in [1], that (2.11) is a necessary and 
sufficient condition for optimality of the system. The optimality 
here, is in the sense of the following definition from [1]. 
Definition: In connection with the LQR problem ,a feedback law is 
optimal if there exists a p.d. or p.s.d. state weighting matrix and 
a p.d. input weighting matrix such that the resulting quadratic 
cost function is minimized by the feedback law under consideration. 
For an SISO system, the inequality (2.11) becomes 

ic 
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Thia naans that for the optinal CL aysten, the Nyquiat 
plot of the return difference will not enter the unit circle 
centered at (-1,J0) on the return-difference plane. 

This indicates that the optinal CL aysten posaeaaea 
infinite gain nargin, 50 k gain reduction tolerance and a phase 
nargin of at least ±60 degrees. 

For an nino aysten, it is shown in [13] that if N is 
the perturbation in the aysten as shown in fig. 2-a .then the CL 
aysten renains stable for N satisfying the following : 

N « diagCn ,n ,...n ) and 

dl 2 m 

I n*+ aj > 1 (2.12) 

If N is real .it can be easily shown that (2.12) is 
satisfied when n^ « (ly's.oo). This is the gain nargin analogy. 

Also if n^ * e"’’^ .with Iv'l < n/a , (2.12) is 

satisfied. This is the phase nargin analogy. 





2.3 The Discrete Tine LQR 

Consider a discrete-time LTl system , whose dynamics is 

modeled as 

V. ' -—(2.13) 

where is the state vector at the k*’*' instant, 

Uj^is the input vector at the tR”* 

A « e"’**' and B « R*'**”‘ are constant state and constant 
input matrices respectively. 

It is required to minimize the performance index, 

Ob 

J = E * Q ^ 0 , R > 0 (2.14) 

kso 

where both Q and R are symmetric and real with Q « 

. _ —TOxrni 

and R « E 

It is assumed that (A.B) is controllable and (A,D) is 

T 

observable; where D D » q . 

It is known, [14], that the control law, 

Uj^= - K (2.15) 

where 

K = (R + b’^P B)"V P a ( 2 . 16 ) 

is the optimal control law. 

Here, 'P’ is the p.d. symmetric unique real solution to 
the discrete-time ARE (DARE) 

P - A^P A + a’'p B K = 0 . (2.17). 

The corresponding CL system is then 

X|^^^= ( A - B K) x^ . (2.18). 

From DARE (2.17), the spectral factorisation of the 
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Add 'z(A’‘p-a'*“P) + z^^CP A-P A)’ to the L.H.S. of (2.17) 

to set 

z(A'^P-a’‘P) + z“^(P A-P A)+ P - a'^P a + a"*"? B K = Q . 
Rearranging , ve get 

(z'^I - a’‘P) P (zI - A) + a'^PCzI - A) 

+ (z"*i - a’’p)P a + a’‘p B K = Q . 

Mow multiply on the left by **= (z"^I - A*^)"* and on 

the right by * = (zl - A)“‘, to obtain 

p + «*a'*‘p + p a « + ®*a’‘p B K « = «*Q * . 

Also multiplying on the left by B^ and on the right 

by B gives 

b’‘p B + B'*‘**a'*‘p B + b"^? a * B + B*'**a’P B K S B = B^S*Q * B . 

Add ' R ’ to both sides to obtain 
R + b’p b + b’‘«*a’‘p b + b’‘p a * b + bVa^'p B K * B 

= R + b’‘**Q * B 

i.e. 

R + b'*‘p B + bVa^P B(R + b’‘p B)‘‘(R + b'*‘p B) 

+(R + b’^p b)(r + b’‘p b)'^b'*‘p a « B 

+ b’‘**a’‘p B(R + b’p B)”‘cR + b’p B)K s b 

= R + W*Q W 

where U f B. 

This simplifies to 

(I + b'*‘«*k'')(R + B^P B)CI + K*B)=R + lfQW (2.19). 

(2.19) is the return difference equality. 

Using (2.19) ,a necessary condition for optimality of 
(2.18) can be derived as follows [16]. 
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(R + b'^P B) F(z) = r + i/'q w . 

Taking deteriainant of both sides of the above equation 


we have 


dett f’Cz"*) F(z) 3 


dett R + W*Q U 3 
det[ R + b’p B 3 


det [ 

I 

+ R"^^® 

U*Q 

U 

R-ix* 

3 

det [ 

1 

+ R-‘^® 

b'^p 

B 

R- tyz 

3 


( 2 . 20 ). 


Let 

y^Cz) = Eigenvalues of R"*'^*l^Q U 

= Eigenvalues of R"‘^*b'^P B 

P^(z) = Eigenvalues of F(z) 

where i = 1 , . . ,in. 

Now, eigenvalues yA.z') are non-negative when \z\ - 1, 

since Q is p.s.d.,and hence R la Q UR is also p.s.d. for 

|z| s 1 . Similarly eigenvalues are real, positive since the 
matrix R B P B R is symmetric ,p.d. and constant. 

On the other hand, 

m 

dett F(z)3 = n 

isi 

and 

|F'*‘Cz‘*) F(z)| = lF(z)|“ for |z| = 1 . 


Then we have from (2.20) 


m 


n [ 1 + p. (z)] 


n = 


( 2 . 21 ) 


ia i 

i a A 

For m = 1, we have 


n [ 1 + (9. (z)] 


12 


Cz) 


Since is non-negative and 


X * ft 1 + ft 

i ' 1 


is positive. 


or , 


|,i> (2)1* > — i— 
1 + 


|p^(z)| 

Sinllarly for n 


1 

“ (1 + (?^)*^* 

= 2 , it can be shown that 


|p/z)| |p^(2)| 


1 

I (1 + /9^)(i + ft^n^''’" 


Proceeding in a similar way, it can be 
written that, for |z|=l, 


generally 


|det [F(z)]l 5s i dett I + R“*''®b'*P B R"*^* ] >“*'^* — (2.21). 

It is then concluded that a necessary condition for 
optimality of (2.15) subject to minimization of cost J in (2.14) is 
that the complex plane plot of |det[F(z)]|, when \z\= 1 ,must not 
penetrate the interior of the circle centered at the origin and 
having the radius of 

A - { dett I + R"*''®b'*‘p B R'*^* ] r*'"* (2.23) 

Note that A is always less than unity. 

The graphical representation of this optimality 

property is shown in fig. 2-b. 

For an SISO system, (2.23) would mean that the Nyquist 
plot of the loop transfer function of an optimal system will not 
penetrate a circle of radius A={ [1 +bP b]/ rf 


centered at 
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phaae margin. The upward gain margin is calculated at point 1 and 
the gain reduction tolerance is calculated at point 2. 

From the geometry of the figure, it is seen that 

sinCdy's) = A / 2 

Hence, 

d = 2 sin" ‘(A / 2) . 

It is seen that at point 1, |F(z)| = 1-A. Hence the 
system would become unstable (i.e. |F( 2 )| would reach the point 
(-1,0)), only when it is multiplied by a gain factor of (l-A)"* or 
a value less than that. Thus the upward gain margin is (1-A)~*. 

Similarly, at point 2, |F(z)|= (1+A). Hence the 

downward gain margin is (ltA)~^. 

In [9], the gain and phase margins for an HIHO system 
have been defined and these are obtained for the DLQR. The 
development goes as follows. 

The basic condition for stability of an ninO ,CL system 
is that there exists a positive scalar , such that 

tf(F(z)) S: Rj > 0 for all |z| = 1. 

Here F(z) is the RDM of the system under consideration 
and ^(-) denotes the smallest singular value of (*)• 

The size of the guaranteed stability margins of the 
DLQR van be related to the value of R^. 

The minimum guaranteed upward and downward gain margins 
of the LQR are defined as the positive scalars and 

which , a simultaneous insertions of gains g^ ,in the i^’' feed back 
loop of the CL regulator [i.e. multiplying all the elements of the 
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GM^ £ ^ ; i = 1, . . ,ai. 

Similarly, the guaranteed phase margin o£ the regulator 
Is defined to be the scalar PM for which a simultaneous Insertion 
of the phase factor e’'^ In the 1 feed back loop will not 
destabilize the system If , 

I :& m ; i - 1, .. ,m. 

The following theorem In [9] gives the guaranteed gain 
and phase margins for the DLQR In terms of the system elementary 
matrices and the weighting matrices In the performance Index. 

Theore m 2.1 ; The minimum singular value of the RDM F(z), of the 
DLQR, Is bounded from below, for z that traverses the unit circle, 
by R^, where, 

R 

where, = 1 form^n 
s 0 otherwise. 

Indicates the largest singular value of (-). 

S = o-CQ) [1-0- for case 1. 

= o’CO) [ 1 “ oi *]"* for case 2. 

= [^(Q) + [ 1 - « *r* for case 3. 

oi = max I X^(A) I ; 1 = l,..,n. 
y = ^(V^) 5-CV^B) ^■*CA^)5'(R)(« *-1)2"‘'^*CR)$:“®C^ V ) 

where A and V are defined by the following spectral 
decomposition of A. 



2 

f 




o-CR) + & *(B) 




1 + 


e *(R) ^ *(Q) 
5^(R)[1 + 5-(A)]‘ 


k 


1 


xo 


where consists o£ Jordan blocks that correspond to 
fleenvalues inside the unit circle and Aj consists o£ all the other 
ordan blocks. 

oi = msx { a* ,1 / a' ' } 
a' = max jX^(A)l 
a" = max |X'j^(A)| 

X^(A)ar6 the eigen-values o£ A outside unit circle. 

(A)are the eigen-values o£ A inside unit circle. 

The three cases reierred to above are the following 
•nes: Case 1: X^(A) < 1 and o-CA) < 1 for all i =l,..,n. 

Case 2: X^(A) < 1 and aCA) ^ 1 for all i =l,..,n and 
.11 X^(A) are distinct. 

Case 3: X^(A) are all distinct ,!X^(A)1 p* 1 ,X^(A) > 1 

or some i, X. (A) p^X’/cA), for all i =l,..,n and for all J =l,..,n. 

i- J 

The guaranteed upward and downward gain margins of the 
egulator are given by 

GM^ = ( 1 + ; GM^ = ( 1 - R^)"* (2.24) 

and the positive and negative phase margins of this 
egulator are given by 

PM = ± cos“‘c 1 - I r“ ] (2.25). 

.4 The CLQR Uith Prescribed Degree Of Stability 

If the performance index of (2.2) is modified to 

j = x+ u ^ u J dt (2.26) 

where Q > 0 , R > 0 and s is a positive scalar, 

C! Ck 

hen the optimal control law which minimizes (2.26) subject to 
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u = - L^x (2.27) 

where 

(2.28). 

is a p.d. synuR. unique real solution to the 

CARE 

[F+ + m’’ IF+ £1) -MG R"*G^H + Q =0 (2.29). 

The resultine CL system is 

* = (F - G L ) X (2.30) 

i£r 

and this CL system possesses a prescribed degree of 
stability s [13]. In other words, the CL poles of the system (2.30) 
lie on the left half of the vertical line through the point 
(-*,j0), on the s-plane. 


2.5 The DLQR Uith Prescribed Degree Of Stability 

In the discrete-time case also, introducing a weighting 
term into the performance index allows to achieve a prescribed 
degree of stability [17]. 

Suppose that we modify the performance index of (2.14) 


= E Qx^ + u^Ru^] ; Q2:0,R>0 (2.31) 

kxsO 

where <x > 1 is a scalar. 

2k k k 

Ue can distribute oc in J as <x <x and write it as 

QC 

= E [(«*k) Q («\) + 

k so 

kso 


(2.32) 
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The equationa in z and v are readily found. Using 
'2.33) we have 


k-i-i 

Z, a OC K, 
ki- i. 


Substituting from (2.13) ve get 


k+i f , 

z. = oc [Ax, 
k+l k 


+ B 








kf A 


= « [A Vj^] 


*k.. = ■* \ 


k-hi 


A z, + B V 
<x k oc k 


where , A * « A and B = oc B 

OC <x 


(2.34) 

(2.35) . 

Now, for the systen (2.34), with perforaiance index 
'2.32) as stated in the earlier section, the optimal control law is 
liven by 

v=-Kz (2.36) 

k « k 

where 

(2.37) 




and, is the p.d., symmetric unique real solution to 


the DARE 


P -A P A +A P B K 
oc oc oc oc oc oc oc oc 


(2.38) 


Now working on (2.36) backwards, we get 


k ^ k 

“ ■‘k 


or 


\ *k 


(2.39). 

Ue conclude from all this that the use of control law 
C2.39) in (2.13) optimizes the performance index in (2.31). 
Furthermore, the state trajectory also satisfies (2.36) where is 


\ state vector so that Xj^ must decay at least as fast as (l/ot ) or 



19 


Thus, in other words, minimizes and guarantees 
Che CL poles inside a circle of radius ±/at centered at origin on 
5-plane (Note that 0 < 1/a < 1). 

2.6 Conclusions 

It was seen that the CLQR possesses excellent 
robustness properties. The robustness properties for the DLQR are 
lot as good as those for CLQR. Nevertheless, DLQR does possess 
guaranteed stability margins. These, however, are dependent on the 
system parameters and the cost function matrices, unlike the case 
>f CLQR. Certain modification in the performance indices gives rise 
to an optimal system with prescribed degree of stability. 
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CHAPTER # 3 

ROBUSTNESS WITH PRESCRIBED DEGREE OF STABILITY 

.1 Introduction 

The advantages of LQR with prescribed degree of 

tability over that without a prescribed degree of stability are 
nown [5], The extra robustness that a CLQR with prescribed degree 
f stability possesses, has been exploited in [6]. Ue will briefly 
eview this development. A similar development is attempted 
.fterwards for the case of DLQR with prescribed degree of 

tability. 

.2 Robustness Of CLQR Uith Prescribed Degree Of Stability 

Recently in [6], a robust control design algorithm is 
liven. This uses the robustness properties of the CLQR with 
prescribed degree of stability. A sufficient condition is derived 
:o show that a nominally optimal control law designed with adequate 
legree of stability remains optimal (in the sense of the definition 
liven in Chapter 2), for perturbed system with fixed perturbations 
.n the state matrix. This necessarily means that the perturbed 
lystem is suboptimal as far as the design performance index is 
:onsidered, but it is optimal for some other quadratic performance 
.ndex (without prescribed degree of stability) with different 
ralues for the weighting matrices. This means that the return 
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properties of infinite gain nargin, 50 % gain reduction tolerance, 
and phase margin of ± 60“ . 

The development goes as follows: 

Consider the LTI system, 

it = F X + G u ;x(o)= (3.1) 

where x « CR’', u « R™, 

F « r"**” and G « r*'*'"* are actual constant state and 
constant input matrices respectively. 

The corresponding nominal (design) system is described 
by 

X = F^x + G u (3.2). 

The perturbed state matrix F and the nominal state 
matrix F are related by. 

Cl 

F s F + AF (3.3) 

o 

where AF is the fixed perturbation in the state matrix. 

An optimal control law is designed for the nominal 
system (3.2), to minimize the performance index, 

x+ u u ] dt (3.4) 

where Q ^ 0 ; R > 0; and £ is a positive scalar. 

c c 

Ue assume that (F,G) is controllable and (F,D ) is 

w 

T 

observable, where 0 D = Q . 

c c 

The optimal control law which minimizes (3.4) subject 
to (3.2) is given by 

us- L x (3.5) 

where 

L, = (3.6). 
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+ «■*“ F - M G R'^g’m + Q =0 (3.7) 

a £ £t £ C j&*C 

where F = F + j£? I (3.8) 

^ O n 

1^ ie the identity matrix of dimension n x n. 

The use of optimal control law (3.5) in the nominal 

system (3.2) results in a CL system, 

X = (F - G L ) X (3.9). 

o a' 

The CL system (3.9) has a degree of stability £■ 

However, when used for the actual system. It results in 

a suboptimal performance and the corresponding cost is given by 

J=x'*^Mx (3.10). 

a o o 

Assuming that the perturbed CL system, 

ie = (F- G L^) X (3.11) 

is stable, M is obtained as a unique, p.d. symmetric 
real solution to the Lyapunov equation, 

Pm + m’f +l’^R L + Q = 0 (3.12) 

£ £t £ C £ C 

or equivalently of 

f’^M + M^'f +l’‘r L + Q + 2£M = 0 (3.13) 

S' c & c 

where F = F + eI--GL (3.14) 

S T% £f 

and F = F - G L (3.15). 

s 

The following theorem appears as the main result in 

[63. 

Theorem 3.1: The control law L. remains optimal for the actual 

■M M m MW wn mmmmmmmmm 

system (for some other pair of performance index matrices and 

R^) ; or equivalently, 

[1+ H(Jw)]*CI+ H(j6>)] i I holds for all <■>, 


if 
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least p.s.d.)* 


The proof of the theoren is presented in brief to get 
the idea of the developnent. 

Ue have 


M + P + R 

£ jS it C 

^ ( F - G L )’‘ll + ( F - G L ) + 

S’ 4D S 

Now treating this along the 
up to equation (2.10-a), this leads to 


R 

it C 


1 ines 



s B 


£ 

equation 


(2.5) 


[1+ HCj6>)]*[I+ H(jai)] = I - E ZCj6j) (3.17) 

s 

where HC» = R^*^*g'*‘( jail - F)'‘ G 
and Z(j«) = B (jwl - F)"*. 

From this, it is observed that if E is at least 

it 


n.s.d. , then 

[1+ H(j6>)]*[I+ H(j6>)] a I (3.18). 

E can be further sinplified to 

s 

E = AF'*’ M + MAF -(Q + 2fiH ) (3.19). 

it an c a 

Thus a condition on AF and it is found out (viz. E of 

Iw 

(3.19) should be at least n.s.d.). Uhen this condition is 
satisfied, the actual system (3.1) with control law of (3.6) is 
optimal for some other pair of performance index matrices, Q' and 

w 

R' . Significantly, whatever are Q' and R* , the system inherently 
possesses the important robustness properties of CLQR which are 
derived from the return difference inequality of (3.18). 

In this way, a spectral factorisation of the RDN of the 
actual system is achieved. This needs the above-mentioned condition 
on E to be be satisfied. 
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the perturbation matrix AF. 

The main aim of our thesis has been - to find out a 
similar condition in case of discrete-time systems. 


3.3 Robustness Of DLQR With Prescribed Degree Of Stability 

A discrete-time analogy of the above result [of section 

(3.2)] was tried. In continuous time case, the spectral 

factorisation of the RDH of the actual system was found out. In 

that, the perturbations in the state matrix F were considered. 

o 

Apparently it is observed that such a result is possible for the 

continuous-time case, because the expression for the control law 

viz. , L = R“ does not explicitly involve the matrix F whose 

perturbations are considered. 

On the other hand, in the discrete-time case, the 

expression for optimal control law is 

K = [ R + b’‘ P B ]"*b'*‘ P A 
oe oc oc cn oc oc ot 

which explicitly involves A (since, A^= « A). Hence in 
the discrete-time case, deriving the spectral factorisation of the 
RDM for the actual system [e.g. equation (3.17) for CLQR] , from a 
Riccati-type equation [equation (3.16) in case of CLQR] was not 
possible . 


One more important difference between the CLQR and the 
DLQR is the following. In case of the CLQR, the return difference 
inequality gives rise to the stability margins for the CL system, 
which are independent of the system parameters, viz. for any LQR, 
(with whatever values of F,G,Q and R ) the gain margins are 1/2, oei 
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gain margins for the system described by (2. 13)-(2 . 18) , are given 
by 


downward gain margin = ( 1 + A )“ 

upward gain margin = ( 1 - A )"* 

and the phase margins are ± 2 sin~*( A / 2 ). 

Here, A = •{ det[ I + P B which is 

clearly dependant on all system parameters; which makes the problem 
more complex. 

Hence, first the stability margins for the DLQR with 
prescribed degree of stability oc, (oc > 1) are developed and these 
are compared with those without any prescribed degree of stability 
(« = 1 ). 


Consider the system of (2.3) viz. 


Ue know that for minimizing. 


a> 


J = 
oc 


1 = 1 

the control law obtained is 


u. = - K X, 
k oe ^ 

K = (R + P B )“‘b’*‘ P B 
oc ^ ocococ'^ococoe 


where 


oc 

Hence 


oc A 


and, B^ = oc B 


= oc*CR + b'"oc®P^B )-"B’"P^m 


(3.20) . 

(3.21) 

(3.22). 

(3.23) 

(3.24). 

(3.25). 


P is the unique, p.d. , symmetric, real solution to the 

(X 


DARE, 
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oc 


P A 

CtC 


+ A 


P B K 
oc <x 


Adding P^ - to both sides gives 

P_ - a’' PA + a'^P B K = Q / Qe*+ P (1 - 1 / «*) . 

oc oc oeoe"' oc • ' 

Define ^ Q / «*+ (1 “ 1 / ** 5 

^ P_ - a’‘p A + a"**? B K = Q. . 

oc oc oc oc *1 

Add 'z(a’'p-a'*'p) + 2"*(P A-P A)’ to the L.H.S. to get 

zCA***? -a'*‘p ) + z"*(P A-P A)+ P - A^P A + a'^'p B K = Q, . 
ococ' 'ococ'oc oc ococ*l 

Rearranging , ve get 

(z'*I - a’‘p ) P (zl - A) + a’p (zl - A) 

OC cc cc 

+ (z'^I - a'*‘p )p a + a'*‘p b k = Q, . 

' oc' oc oc oc *1 

Now multiply on the left by 5*= (z”*I - A**^)'* and on 

the right by * = (zl - A)"*, to obtain 

P + **a'*‘p + P a * + **A*P B K * = **Q. * 

oc oc oc oc oc 1 

Also multiplying on the left by B* and on the right by 


B^ gives 


b’‘p B 

OC OC OC 


b’‘s*a’^p b + 

OC oc oc 


b’‘p a * b 

OC OC oc 


b’‘s*a*‘p b k* b = bVq,® b 

oc oc oc oc oc "1 oc 


Using (3.24), we have 

b'*‘p B + oc B^®*A^P B + b’J,? A « oc B + oc B*«*a'p^B K * oc B 

QCQCOC OCOCOCOC OCOC 


= b'^«*q,s b . 

oc *1 oc 


B*P B + b'*‘**a’‘p B + b’'p A„* B + b’‘**aXp^B. K « B 

“ “ ■ “ ■ ^ OC OC OC OC 


oc oc oc 


oc oc oc oc oc oc 


b''**q,* b . 

oc 1 oc 


Add R to both sides to obtain 


R + b’p .B. + b’‘**a!‘p^ B„+ b1p„A„* B + b’‘**a’p^B^K^« B 


OC OC OC 


oc oc oc oc oc oc 


R + bVq.* B . 
oc *1 oc 
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+ (R + B'*‘p B )(R + B*^? B )"*b’‘p a S B 

OC 0£ CjC''^ QC CjC QC^ QC CiC oc 

+ b’**a'^P B (R + B^'p B r*(R + b'^P B )K * B 
4C <x oc at at at at at at 


= R + 


W*QlW 


where U » 2 B 

at 

This simplifies to 

(I + b’*‘**k][,)(R + b’‘pB)(I + K«B)=R + U*Q,U (3.27). 

at"^ atatat^' at 1 

(3.27) is the return difference equality for the system 
(3.20)-(3. 21) . Henceforth we would use a notation to refer to this 
system as (A,B,K^). 

The return difference of this system is 


F(z) = (I + K^* B) (3.28). 

From equation (3.27), we find out that for this system 
a necessary condition for optimality derived on the similar lines 
of the reference [16] is given by, 

Idet [F(z)]| a { dett I + B^ R"*''* 1 }'^''^ 

= { det[ I + R"*''®B’oe*P^B A —(3.29). 

It was not possible to establish an explicit and useful 
relationship between P^ of (3.29) and P of (2.17), involved in A 
for the system (A,B,K) viz. 

A A 4 det[ I + R‘*''®b’p B R"*^® ] —(3.30). 

But it is verified from some numerical examples (some 
of them to follow) that 

a«®P > P (3.31) 

oc 

so that, 

A < A (3.32). 

« 

In [18], it is shown that for the system (A,B,K) if we 
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then the gain nargine of the eystein are 

downward gain margin = C 1 / P (3.34) 

upward gain margin = [ (l+f>) + (l+^ )*''“ 3 / — (3.35). 

The largeat margins correspond to the lowest value of 
p. Now, since we have 

«*P > P 

oc 

hence 


B^’oe^P^B > b’p B 

which again means that the margins obtained in case of 
oc > 1 are smaller than those for oc = 1 . 

A similar result comes out if the margins are derived 
as in [19]. It is, however, observed that the margins derived above 
for oc > 1 are more conservative than those for oc = 1. This is 
evident from the following facts: 

Ue have for oc 1 

(I + B^**k'*‘)(R + b"^? B)(I + K * B) = R + ifQ W (3.36). 

Since Q is p.s.d., for \z\ = 1, U*Q U is also p.s.d. 


and hence we get. 


(I + b’*‘**k’*‘)(R + B)(I + K * B) > R 


(3.37). 


The margins are calculated using the inequality of 

(3.37). For the case of oc > 1 , we have 

(I + b’**k’‘)(R + b’^PB)(I + K«B)=R + b’^s*q.s B 
oc ocococ'^' oc Qc loc 

Replacing and using (3.24) we get 
(I + b’**k’)(R + b’'oc*P^B )(I + KJt B) 

= R +bV[Q + P^(oc*-l)]* B (3.38). 

Now, the term [ Q + P^ («*-!)] is positive definite and 
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(I + b’^**K^)(R + )CI + B) i R (3.40) 

and hence the conservat ivenesa of the narfiins 

increases . 

In what follows, we analyze the results in a different 
perspective. Here, it is proved that the nargins derived for oe > 1 

are the margins before the CL poles of the system come out of the 
circle of radius 1/cc , centered at the origin on the z-plane. In 
that sense, these margins are the measure of the nearness of the CL 
poles to the circle of radius l/<x and hence the stability margins 
derived for oc > 1 are with respect to the circle of radius l/oc 
centered at the origin. 

Ue know that for the system of (2.13), with the 
performance index J of (2.14) the return difference equality is 

(I + K « B)*(R + b’‘p B)(I + K * B) = R + W (3.41). 

Now consider a system, 

X, = A X + B u (3.42) 

where 


A * « A and, B = tx B 
« « 

For minimizing, 

J = E tx’ Q \ R \ 3 

isft 

the optimal controller is given by 

K = (R + b’’ P B P A 

oc ^ oe oc oc*^ oe oe oe 


(3.43) 


(3.44) 


DARE, 


p^ is the unique, p.d., symmetric .real solution to the 


P -A P A + A P B K = Q 
oc ocococ oeocococ 


(3.45) 
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(I + K i B )’*(R 

^ QC OC ^ 


b"**? B )(I 


K $ B ) 
« oc « 


= R + 


bVq 

0£ at 


i B 

QC OC 


— (3.46) 


where 


» (zl - A^)"‘ = (zl - « A)"‘ (3.47). 

This neans, 

[I + K (zl - « A)'*« B]*(R + b’‘«*P B )[I + K (zl - oe A)“‘o£ B] 

(X CtC 

= R + (S£®B^(z"*I - ae A)"’q (zI - ot A)'*B on 1 z| =1 

■* t i+K^C |i - A>'V‘« b]*cr + b’«*p^b)[ i+k^c 19 

» R + oe*[C |l - AyV^B] *Q C |l - ^'V^B on 1 zj =1 
[ I + |l - iO'‘B]*CR + b'*'«*P^B)[ I + K^C 

= R + [C *Q < |l - A>'‘b on I zl =1 

which is equivalent to saying that 
[I + K (zl - A)'*B]*(R + b'*‘«*P B )[I + K (zI - A)‘^B3 

QC OC OC 

= R + [(zl - A)'*B]*Q [(zl - A)’‘B3 on izi_=_l/_« 

i.e. 

(I + KJ B)*(R + b'*‘«®P^B)(I + KJb B) 

= R +b''**Q SB on izi_f_l/_« (3.48) 

where, i = (z I - A )~*. 

Note that (I + K S B) is the return difference for the 

« 

system (A,B,K^). 

Hence we have for (A,B,K ), 

oc 

Idet [I + K^S B3I 

S: ■{ det[ I +R"*^*b''«®P^B (3.49) 

which is also valid on |zl= 1/cc. 

This means that the gain and phase margins derived from 
A are valid on the circle {zl = 1/st, which is to say that the 
system has these margins, before its CL poles come out of the 



Closed loop poles are 
(-.15049, -.39307) 

(-.15049, .393072) 
(-8.67361E-19,-6.93889E-18) 

Alpha = 1.0 

DET. OF RDM ON iZ| « 1.0 


Sno. 

Th 

Det 


iDet 1 

1 

.0 

.985428 

.000000 

.985428 

2 

12.9 

.994358 

.049554 

.995592 

3 

25.7 

1.023516 

.099875 

1.028377 

4 

38.6 

1.081302 

.150028 

1.091661 

5 

51.4 

1.186778 

.191820 

1.202180 

6 

64.3 

1.376304 

.186463 

1.388878 

7 

77.1 

1.658724 - 

.019033 

1.658833 

8 

90.0 

1.645691 - 

.601975 

1.752334 

9 

102.9 

1.083050 - 

.821697 

1.359479 

10 

115.7 

.750966 - 

.619305 

.973391 

11 

128.6 

.638847 - 

.420848 

.765009 

12 

141.4 

.601877 - 

.277471 

.662756 

13 

154.3 

.589278 - 

.169581 

.613193 

14 

167.1 

.585090 - 

.080692 

.590628 

15 

180.0 

.584111 

.000000 

.584111 


Min value of Oet . - .5841112732887268 


It********************************************** 

Alpha = 1.2 

Ict********************************************* 

Lower Bound on DET( I + K * PHI * B ) 

[Equation (3.29)] 

0.2372425159798326 

Solution to the DARE is 

1.26434982596346 -.20060347871451 -.528699651926912 
-.20060347871451 2.09150358738945 .4012069574290193 
-.528699651926912 .401206957429019 1.0573993038538^ 

Eigen-values of alp'Z Palpha - P are 
(.294124, .0) 

(.738923, .0) 

(1.5653, .0) 

The LQR controller is 

f5.170192750373961E-02 .4609526836625133 -.103403855007479 
-.276394245708663 -.229343946297915 .5527884914173254 


Closed loop poles are 
r- .13^87 . - 301214'» 
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Alpha = 1.2 

DET. OF RDM ON |Z| = 1.0 


Sno . 

Th 

Det 

IDet 1 

1 

.0 

.920622 

.000000 

.920622 

2 

12.9 

.930210 

.064776 

.932462 

3 

25.7 

.961664 

.131623 

.970630 

4 

38.6 

1.024664 

.201217 

1.044234 

5 

51.4 

1.141805 

.267433 

1.172706 

6 

64.3 

1.359321 

.292303 

1.390393 

7 

77.1 

1.708833 

.106297 

1.712136 

8 

90.0 

1.781618 

-.543485 

1.862670 

9 

102.9 

1.189094 

-.865340 

1.470631 

10 

115.7 

.794742 

-.683090 

1.047963 

11 

128.6 

.647113 

-.474208 

.802265 

12 

141.4 

.591820 

-.316277 

.671031 

13 

154.3 

.569617 

-.194556 

.601927 

14 

167.1 

.560707 

-.092888 

.568349 

15 

180.0 

.558299 

.000000 

.558299 


Min value o£ Det . » .5582988858222961 

DET. OF RDM ON |Z| = 1.0/alp 


no. 

Th 

Det 

IDeti 

1 

.0 

.862399 

.000000 

.862399 

2 

12.9 

.870229 

.079501 

.873852 

3 

25.7 

.896228 

.165701 

.911417 

4 

38.6 

.950019 

.267413 

.986938 

5 

51.4 

1.058213 

.398399 

1.130724 

6 

64.3 

1.304625 

.576440 

1.426299 

7 

77.1 

2.025542 

.702058 

2.143760 

8 

90.0 

3.009875 

-1.164611 

3.227332 

9 

102.9 

.896093 

-1.507618 

1.753823 

10 

115.7 

.520335 

-.841560 

.989430 

11 

128.6 

.474390 

-.517576 

.702091 

12 

141.4 

.473073 

-.329331 

.576417 

13 

154.3 

.477945 

-.198493 

.517524 

14 

167.1 

.481838 

-.093932 

.490908 

15 

180.0 

.483223 

.000000 

.483223 


Min value o£ Det. * .4832231700420379 

Bound on det [ I+K*PHI*B] ; .2372425159798326 

*********************************************** 
Alpha s 2.0 

*********************************************** 


Lower Bound on DET( I+K*PHI*B) 
[Equation (3.29)] 

6 . a 00 «17 2il2 5»4 7n7n»iE-n2 
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^lution to the DARE is 

1.66232671568697 -.928022924168846 -1.32465343137393 
-.928022924168846 3.77876957085853 1.85604584833769 
_-l .32465343137393 1.85604584833769 2.64930686274786 

Eigen-values of alp'‘2 Palpha - P are 
(21.2166, .0) 

(2.1094, .0) 

(5.2788, .0) 


The LQR controller is 

.1031136582409829 .5801367143490524 -.206227316481966 
-.293516848964102 -.342587008171782 .587033697928203^ 

Closed loop poles are 
(-7.06665E-02,-.11839) 

(-7.06665E-02, .11839) 

(1.58203E-16,-2.75143E-18) 

Alpha = 2.0 

DET. OF RDM ON |Z| = 1.0 


no . 

Th 

Det 


|Det 1 

1 

.0 

.773562 

.000000 

.773562 

2 

12,9 

.782811 

.089713 

.787934 

3 

25.7 

.813513 

.184358 

.834140 

4 

38.6 

.876554 

.288533 

.922820 

5 

51.4 

.998749 

.402618 

1.076848 

6 

64.3 

1.241625 

.498611 

1.338001 

7 

77.1 

1.687722 

.400535 

1.734599 

8 

90.0 

1.961980 - 

.282666 

1.982238 

9 

102.9 

1.417406 - 

.795312 

1.625288 

10 

115.7 

.947988 - 

.701858 

1.179528 

11 

128.6 

.741460 - 

.510161 

.900015 

12 

141.4 

.651432 - 

.348376 

.738735 

13 

154.3 

.609610 - 

.217089 

.647110 

14 

167.1 

.590633 - 

.104334 

.599777 

15 

180.0 

.585118 

.000000 

.585118 


Min value of Det. = .5851179957389831 



DET. OF RDM ON |Z| = 1.0/alp 


Sno . 

Th 

Det 


IDet I 

1 

.0 

.452902 

.000000 

.452902 

2 

12.9 

.447387 

.104334 

.459392 

3 

25.7 

.428410 

.217089 

.480274 

4 

38.6 

.386588 

.348376 

.520400 

5 

51.4 

.296560 

.510161 

.590095 

6 

64.3 

.090032 

.701859 

.707609 

7 

77.1 

-.379386 

.795311 

.881166 

8 

90.0 

-.923960 

.282666 

.966231 

9 

102.9 

-.649701 - 

.400534 

.763243 

10 

115.7 

-.203605 - 

.498611 

.538579 

11 

128.6 

.039271 - 

.402618 

.404529 

12 

141.4 

.161466 - 

.288533 

.330640 

13 

154.3 

.224507 - 

.184358 

.290502 

14 

167.1 

.255209 - 

.089713 

.270518 

15 

180.0 

.264458 

.000000 

.264458 


Min value of Det. = .2644580006599426 

Bound on det ( I+K*PHI*B] : 6 . 499572522470705E-02 

*********************************************** 

Alpha = 2.8 

*********************************************** 

Lower Bound on DET( I+K*PHI*B) 

[Equation (3.29)} 

2.502080204346506E--02 

Solution to the DARE is 

2.26554678694545 -2.11180601036565 -2.5310935738909 
-2.11180601036565 6.2302038385915 4.2236120207313 
-2.5310935738909 4.2236120207313 5.06218714778179 _ 

Eigen-values of alp^2 Palpha - P are 

(85.4056, .0) 

(4.8962, .0) 

(12.2357 , .0) 

The LQR controller is 

.1266070749619696 .6264865804201737 -.253214149923939 
-.292680488563275 -.380105237440033 .5853609771265503 


Closed loop poles are 
(-3.93243E-02,6.06199E-02) 
(2.32019E-17,1.73472E-17) 
(-3.93243E-02,-6.06199E-02) 



Alpha = 2.8 

DET. OF RDM ON |Z| = 1.0 


Sno . 

Th 

Det 


IDet 1 

1 

.0 

.722580 

.000000 

.722580 

2 

12.9 

.731212 

.095736 

.737453 

3 

25.7 

.760026 

.197370 

.785235 

4 

38.6 

.819865 

.310933 

.876845 

5 

51.4 

.937969 

.439550 

1.035852 

6 

64.3 

1.179226 

.560891 

1.305822 

7 

77.1 

1.643617 

.505222 

1.719513 

8 

90.0 

1.989558 - 

.157297 

1.995766 

9 

102.9 

1.493192 - 

.724907 

1.659853 

10 

115.7 

1.015823 - 

.673993 

1.219083 

11 

128.6 

.794793 - 

.499396 

.938665 

12 

141.4 

.694590 - 

.344234 

.775211 

13 

154.3 

.646558 - 

.215585 

.681553 

14 

167.1 

.624269 - 

.103873 

.632852 

15 

180.0 

.617715 

.000000 

.617715 

Min value of Det. 

- .6177150011062622 


DET. 

OF RDM ON |Z 

1 = 1.0/alp 



Sno. 

Th 

Det 


1 Det 1 

1 

.0 

.256331 

.000000 

.256331 

2 

12.9 

.246924 

.077941 

.258933 

3 

25.7 

.216717 

.155815 

.266917 

4 

38.6 

.159513 

.230950 

.280682 

5 

51.4 

.065286 

.293024 

.300209 

6 

64.3 

-.073098 

.314693 

.323072 

7 

77.1 

-.232954 

.248309 

.340477 

8 

90.0 

-.328447 

.075416 

.336995 

9 

102.9 

-.284786 - 

.113531 

.306582 

10 

115.7 

-.155010 - 

.213745 

.264036 

11 

128.6 

-.027114 - 

.224258 

.225892 

12 

141.4 

.065969 - 

.186676 

.197990 

13 

154.3 

.124862 - 

.129562 

.179936 

14 

167.1 

.156758 - 

.065727 

.169980 

15 

180.0 

.166813 

.000000 

.166813 


Min value of Det. = .1668127179145812 

Bound on det [ I+K*PHI*B] ; 2 . 502080204346506E-02 
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Det(RDM)^\^^2>l ■ 2=^-'® 



Re > 


Flftur* 3-* :D*t. of RDM on |£| « 1. (« » 1.0) 


Del (RDM)= I Pcz^l , z = 



Flaur* 3-b : D*t . of RDM for « = 1.2. 



Del (RDM) 1 Fc2^M - 2 - 



Re — > 


Figure 3-c : D«t. of RDM for oc * 2«0« 


DETCR DM) =ir-cz)l ; i = e-'® 



RE > 


Fi«ur* 3-d : D*t. of RDM for « « 2.8. 
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In the numerical example presented, 

four 

values of 

«, 

viz . , oc 

= 1, 1.2, 2.0 

and 2.8, are considered. 

The 

bound on 

the 

minimum 

value of the 

determinant of the RDM 

of 

the system 

is 

calculated [equation 

(3.29)]. It is seen 

that 

this bound 

is 


satisfied by the values of the determinants of the ROMs on |z|=l. 
It is also verified that the values of the determinants of the RDHs 
on |z|® 1 / «. satisfy these bounds. It is also observed that the 
eigenvalues of - P are positive in each case so that «*P > P. 

The graphical representation of each case is shown in figures (3-a) 
- (3-d). 

Ue have seen that, if a controller is used for a 

system, the system possesses gain margins corresponding to the 

radius A^. The CL systems with lesser degree of stability oc <oc i, 
continue to possess these stability margins, since, as seen 
earlier, the radius A^ decreases as oc increases . Due to 
perturbations, if the CL poles of the system are pushed nearer to 
the unit circle, the degree of stability of the system will reduce. 
But still, the system will continue to possess the margins 

corresponding to the radius A^. 

Consider 3 values of oc , viz., ccicoczcac a. 

Then the corresponding inequalities are 
Idet [F^Cz)]| 5: A^ ^ 

Idet [FjjCz)]| > A^ ^ 

Idet [F^(z)3| 2: A^ ^ 

where Fj^(z) indicates the RDM corresponding to the 

controller K . Now as aeon earlier. 
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Idet [F,(z)]l S: A 

® at a 

and 


Idet [F f 2 )]| > A ^ a A 

Thus, the systeots with lesser degree o£ stability 
satisfy the necessary condition for optimality for higher degree of 
stability. And hence they possess guaranteed stability margins 
corresponding to the radius A 

If we replace A and B in the system of (3.20) by 3 A and 
3B respectively, where 3 is a positive scalar such that 1 < 3 oc, 
the resulting system will be 

i \ * h \ ( 3 . 50 ). 

If for this system, a controller designed for the 
system of (3.20) is used, then the guaranteed degree of stability 
will be less than oc. It will be shown that this CL system continues 
to possess the margins corresponding to the radius A^ (with respect 
to the unit circle). 



[I + K^(zl - « A)'‘« B]*(R + )[I + K^(zl - « A)‘*« B] 

= R + «*B*(z"*I - « A)"'^Q (zl - « A)"*B on | zl = 1 

[ I+K Cz -I - flA y* I « B I^CR+bVp^BX I+K^Cz -fi A}-‘ ^oe B] 
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* K Cz |l - fiA ]*CR + 1 + KC2®-I -e A)'‘e B] 

= R + [(2 |l - SA >‘^SB ]*Q Cz |l - BA B on ! z| = 1 

- I - Ag )-‘B, ]*CR ^ y‘^ ] 

= E ♦ [<z ?! - Ap-‘Bg]*Q (z |l - Ag)-‘ ^ on | z| = 1 

which is equivalent to saying that 
[I + K^CzI - Ag)"*Bg]*(R + b'"«*P^B )[I + K^(zl - Ag )"% 1 

= R + [(zl - Ag)'*Bg]*Q [(zl - Ag)'‘Bg] on 

i . e . 

(■ * ’^Jb * A«*0 ®0> 

= * *®o*s*® *e ®B 25 

where, *g = (z I “ Ag )”*. 

Note that (I + K 3,. B,^ ) is the return difference for 
the system ( Ag,Bg,K^). 

Hence we have for (Ag,Bg,K^), 

Idet [I + K^*g Bg]| 

a { det[ I +R'*''®bVp B a 

which is valid on lz|= fi/oe. 

Note that for all values of fi in the range [l,oe], 
the circles lz|=6/« lie between the circles izl= 1 and |z|®l/eic 
(fig.3-e). Thus the CL system (Ag,Bg,K^) has stability margins 
corresponding to the radius A^ and theses margins are, in fact, 
valid with respect to the circle |z|= S/oc . In the extreme 
case, when B = at , these margins are with respect to the unit 
circle. Ue consider the same numerical example for illustrating 
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EXAMPLE OF BETA VARIATIONS 

IK**************************************************************** 


Alptifit — 2.0 

VALUE OF DET. ON |Z| = 1.0 


Sno . 

Th 

Det 


IDetl 

1 

.0 

.773562 

.000000 

.773562 

2 

20.0 

.796760 

.141368 

.809205 

3 

40.0 

.886477 

.300818 

.936127 

4 

60.0 

1.141333 

.473801 

1.235770 

5 

80.0 

1.800178 

.305875 

1.825979 

6 

100.0 

1.562908 - 

.754417 

1.735461 

7 

120.0 

.858667 - 

.636998 

1.069147 

8 

140.0 

.658329 - 

.364631 

.752564 

9 

160.0 

.599131 - 

.165345 

.621528 

10 

180.0 

.585118 

.000000 

.585118 


Min value of Det . » .5851179957389831 

Bound on det[ I+K*PHI*B] : 6 . 499572522470694E-02 

************************ 

BETA =1.6 

************************ 


VALUE OF DET. ON |Z| = 1.0 


Sno. 

Th 

Det 

1 Det 1 

1 

.0 

.559122 

.000000 

.559122 

2 

20.0 

.557585 

.176790 

.584941 

3 

40.0 

.547520 

.406537 

.681946 

4 

60.0 

.482738 

.825383 

.956187 

5 

80.0 

-.415468 

2.076991 

2.118137 

6 

100.0 

-1.184669 

-1.541263 

1.943947 

7 

120.0 

.103186 

-.744650 

.751765 

8 

140.0 

.291298 

-.380133 

.478911 

9 

160.0 

.346913 

-.167374 

.385179 

10 

180.0 

.360760 

.000000 

.360760 


Min value of Det. = . 3607599735260009 



tictticiicticttictttikticKtieitictic 

BETA =1.7 

iciettiktickicticicttictidtictticltic 
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VALUE OF DET. ON |2| = 1.0 


Sno . 

Th 

Det 

|Det 1 

1 

.0 

.529736 

.000000 

.529736 

2 

20.0 

.524422 

.175425 

.552985 

3 

40.0 

.498587 

.400480 

.639510 

4 

60.0 

.379265 

.789046 

.875463 

5 

80.0 

-.612616 

1.559769 

1.675761 

6 

100.0 

-1.160593 

-.994149 

1.528172 

7 

120.0 

.021723 

-.676334 

.676683 

8 

140.0 

.247874 

-.362191 

.438889 

9 

160.0 

.316186 

-.161630 

.355102 

10 

180.0 

.333199 

.000000 

.333199 


Min value o£ Det . = .3331994414329528 
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It can be seen from the example presented above that for 
a value of 6 , such that 1 < fi < oc , the values of the determinant 
of the RDM of the system (BA, BB ,K^) satisfy the lower bound of 
A^. Hence this system possesses the stability margins corresponding 
to A^. Figure (3-f) illustrates the result graphically. 

Due to perturbations in the system, in the worst case, 
the CL poles will be pushed nearer to the unit circle. A system 
designed with a prescribed degree of stability will have more 
capacity for tolerating perturbations. An explicit condition on the 
perturbations AA was not possible, as mentioned earlier. But a 
numerical example will be presented to justify the advantages of a 
system designed with prescribed degree of stability. The system 
considered la from [21]. 


System Order = 2 

No. of Inputs = 1 

System Matrix [ A ] 
0.0 1.0 1 
-0.5 -1.0 J 


Input Matrix [ B ] 



State weight Matrix [ 0 ] 

r 1.0 0.0 1 
I 0.0 1.0 J 

Input weight Matrix [ R ] 

1.0 

Perturbation Matrix [ D ] 


r 0.0 

0.0 1 

L -0.9 

-0.9 J 


Eiaenvalues of A are 
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A********************************************** 

Alpha = 1.0 

Lover Bound on DET( I + K * PHI * B ) 

[ Equat 1 on (3.29)] 

0.5190440862106403 

The aolution to DARE ia 
r 1.18264830834147 .3219313728029613 1 
[ .3219313728029613 2.71185929880689 J 

The LQR controller la 

[ -.365296616682948 -.643862745605923 ] 

Cloaed loop matrix la 

r c.0,.0) (1.0, .0) 1 

[ (-.1347, .0) (-.35614, .0) J 

Hagnltudea o£ Cloaed loop polea are 

.367019 

.367019 

Cloaed loop perturbed matrix la 

r (.0,.0) (1.0, .0) 1 

[ (-1 .0347, .0) (-1.2561, .0)J 

Mag.of cloaed loop polea of the perturbed ayatem are 

1.0172 

1.0172 

*****)«fA***i)lr*iiir***5*f**A>lf*3ilf*******J(f*****J(r******iilf**)ilf 

Alpha = 1.4 

*********************************************** 

Lower Bound on DET( I + K * PHI * B ) 

[Equatlon(3. 29)] 

0.3349261815598269 

The aolution to DARE la 
r 1.22195611315436 .3999454128983464 "J 
[ .3999454128983464 4.03806062354411 J 

Elgen-valuea of alp'‘2 Palpha - P are 
(1.1596, .0) 

(5.2555, .0) 

The LQR controller la 
[ -.443912226308728 -.799890825796692 ] 

Cloaed loop matrix la 

f (.0, .0) (1.0, .0) ] 

I (-5. 60877E-02, .0) (-.20011, .0) J 



r (.0..0) (1.0, .0) -j 

[ (-.95609,-0) (-1.1001,-0) J 

Hag.of Closed loop poles of the perturbed system are 

.977797 

.977797 

Alpha = 1.41 

Bound on det [ I+K*PHI *B] : 0.33419261815598269 

VALUE OF DET. ON |2| = 1.0 


Sno . 

Th 

Det 

IDetl 

1 

.0 

.411268 

.000000 

.411268 

2 

12.9 

.409121 

.058924 

.413342 

3 

25.7 

.402400 

.120196 

.419968 

4 

38.6 

.390180 

.186594 

.432501 

5 

51.4 

.370574 

.261942 

.453804 

6 

64.3 

.339996 

.352264 

.489579 

7 

77.1 

.291357 

.468366 

.551594 

8 

90.0 

.209149 

.632775 

.666444 

9 

102.9 

.052933 

.903390 

.904939 

10 

115.7 

-.322642 

1.493293 

1.527750 

11 

128.6 

-2.073016 

4.400855 

4.864660 

12 

141.4 

4.255364 

-3.390511 

5.440927 

13 

154.3 

1.896805 

-.963033 

2.127276 

14 

167.1 

1.515123 

-.360730 

1.557473 

15 

180.0 

1.430654 

.000000 

1.430654 


Min value of Det. = .4112676978111267 

********************* 

For perturbed system 
********************* 


VALUE OF DET. ON |Z| = 1.0 


Sno. 

Th 

Det 


IDetl 

1 

.0 

.689270 

.000000 

.689270 

2 

12.9 

.687400 

.011457 

.687495 

3 

25.7 

.681616 

.022640 

.681992 

4 

38.6 

.671368 

.033136 

.672185 

5 

51.4 

.655640 

.042189 

.656996 

6 

64.3 

.632802 

.048298 

.634642 

7 

77.1 

.600451 

.048355 

.602395 

8 

90.0 

.555586 

.035718 

.556733 

9 

102.9 

.496760 - 

.004046 

.496777 

10 

115.7 

.435104 - 

.100152 

.446482 

11 

128.6 

.432355 - 

.287868 

.519422 

12 

141.4 

.623193 - 

.496866 

.797022 

13 

154.3 

.957408 - 

.484108 

1.072842 

14 

167 _ 1 

1.171339 - 

.262694 

1.200435 



•flQura 3-a Dot. of RDH^or pertuebed system 
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It can be aeen from the numerical example presented 

that with the given perturbation, if an optimal controller without 
any prescribed degree of stability is used, then the perturbed 
system does not remain stable. It la found that for the stability 
of the perturbed system, an optimal controller with a mlnlmuffl 
degree of stability « = 1.4 is required. Ulth « = 1.4, the 

perturbed system not only remains stable but also satisfies the 
bound for optimality, resulting in guaranteed stability margins 

corresponding to the radius ^ = 0.3349262. Theoretically, for 

all values of oc > 1.4 , the CL perturbed system becomes stable, but 
it is observed that a very high value of « makes such a design 

numerically impossible. A solution to the DARE in such case becomes 
very large and it creates problems of convergence. 

3.4 Conclusions 

The LQR with prescribed degree of stability Inherently 
possesses greater tolerance to perturbations. Developing the return 
difference equality for the perturbed system la possible in case of 
CLQR, with some condition on the degree of stability. The structure 
of the controller in case of DLOR makes such a result Impossible 
in case of discrete-time systems. A DLQR with prescribed degree of 
stability oc, is shown to have guaranteed stability margins with 
respect to the circle of radius 1/oc .centered at the origin. 
Systems with lesser degrees of stability satisfy the necessary 
condition for optimality for systems with higher degrees of 
stability. This property can be used in the design of a controller 
for systems with known perturbations. i 
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CHAPTER « 4 

CONCLUSIONS 

Owing to certain differences between the continuous-* 
time and discrete-time LQR, a condition similar to that derived in 
[6] for continuous-time systems was not possible for discrete-time 
systems . 

The discrete-time LQR possesses some guaranteed 
stability margins, though these are small as compared to those for 
CLQR. It is shown that the DLQR with some prescribed degree of 
stability, oc, (« > 1 ) possesses guaranteed stability margins for 

the CL system with respect to a circle of radius 1/ot, centered at 

the origin on the z-plane. i.e. These margins are the measures of 

the nearness of the CL poles of the system to the above mentioned 

circle of radius l/« . 

It is shown that if a system with 'fi A' and ' fi B’ as 
its state and input matrices respectively, uses a controller 
designed for the system (A,B), then the resulting CL system has the 
following property. Let us assume that the design model (A,B,K^) 
has GM1,GM2 and PM as guaranteed stability margins (upward gain 
margin, downward gain margin and phase margin respectively) with 
respect to circle \z\ * l/« on the z-plane. Then the actual system 
CeA,eB,K^) is guaranteed to have GMl, GM2 and PM as its margins of 
stability with respect to circle |z| = 1» as lon« as 1 ^ fi ^ 
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